Weight Derivatives |
| There are several methods to compute the weights of an ANN, however, some of these methods require the partial derivative of the mse (mean squared error) with respect each of the weights in the network. The formulas presented below illustrates how to compute the partial derivatives for the mse for a single training case; to compute the partial derivates for the whole training set the average of the partial derivatives for each case is used. |
Output Layer Weights |
In order to compute the derivative of the mse for each weight in the output layer, we need to perform two steps:
|
